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Abstract 

In an important recent paper, [2], S. Franz and M. Leone prove rigorous lower 
bounds for the free energy of the diluted p-spin model and the K-sat model at any 
temperature. We show that the results for these two models are consequences of a single 
general principle. Our calculations are significantly simpler than those of [2], even in 
the replica-symmetric case. 
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1 Introduction. 

Let p > 2 be an even integer that will be fixed throughout this paper. For iV > 1 let 
Stv = {—1,+1} N . Consider a random function 9 : {— 1,+1} P — > K. and a sequence (0k)k>i 
of independent copies of 9. Consider an i.i.d. sequence of indices (ii } k)i,k>i with uniform 
distribution on {1, ... , N}, and let M be a Poisson r.v. with mean EM = aN. Let us define 
the Hamiltonian Hn(ct) on Sat by 

-H N {*) = (1.1) 

k<M 

where H' N (cr) is an arbitrary random function on independent of all other r.v. in (1.1). 
The main goal of this paper is to prove upper bounds for 



F N = i-Elog J2 exp(-F Ar ( < r)). 
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We will make the following assumptions on the random function 0. We assume that there 
exists a random function /:{ — 1,+1}— >M such that 

exp0(<7i,...,<7„) =a(l + 6/i(<ri) .../p((T p )), (1.2) 

where fi, ■ ■ ■ , f p are independent copies of /, b is a r.v. independent of /i, . . . , f p that satisfies 
the condition 

Vn > 1 E(-b) n > 0, (1.3) 
and a is an arbitrary r.v. Finally, we assume that 

|&/i(<ri).../ p (0p)|<la.s. (1.4) 

Let us consider two examples when the conditions (1.2), (1.3) and (1.4) are satisfied. 
Example 1. (p-spin model) Consider (3 > and a symmetric r.v. J. The p-spin model 
corresponds to the choice of 

0((7i, . . . ,cr p ) = pjai ...o v . 

(1.2) holds with a = ch((3J), b = th(/3J) and f(a) = a and condition (1.3) holds since we 
assume that the distribution of J is symmetric. 

Example 2. (K-s&t model) Consider (3 > and a sequence of i.i.d. Bernoulli r.v. (Ji)i>i 
with P(J; = ±1) = 1/2. The K-s&t model corresponds to 

l<p 

(1.2) holds with a = 1, 6 = e~ p - 1 and /,(<T|) = (1 + Ji(Ji)/2 and (1.3) holds since b < 0. 

We now introduce certain quantities that will play a fundamental role in the paper. 
Given a function / : W — > H. and a vector a; = (xi, . . . , x p ) let us define 

, . _ = E ei ,..., ep _ 1= ±i ■■■^p) ex P ECi xiEi 

E £1 ,..., ep _ 1= ±i ex pEi=i xiei 

(so that (/)" implicitly depends on the last coordinate e p ) and 



(/>« 



E ei ,..., ep =±i f( e ii ■■■i £ P ) ex P ELi x i £ i 



E £l ,..., £p =±iexpELi^^ 
Let us define 

£(ei, . . . ,e p ) = exp0(ei, . . . ,£p). 
If the condition (1.2) holds then 

(£)- = (exp 0), = (a(l + 6/!( ei ) . . . f P {e P )))~ x (1.5) 

vfJE^ii /i(eO ex P A ,,,, v TT Av/,(e)expea:,\ 

= a(l + &/,(*,) J! Ee|=±iexp£|Z| ) =a ( 1 + ^ I! C h(x0 ) ' 
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where Av means average over e — ±1 and, similarly, 



<o.=.(i + »n^^)- <-) 

Finally, let us define 

U(9,x 1 ,...,x p . 1 ,e)=\og(£) x \ £p=£ . (1.7) 
In the case of the p-spin model, we have 

(5)- = ch(/3J)(l+th(/3J) £j , J] th(/3x,)) 

i<p-i 

and 

(0. = ch(/3J) (l + ih(pj) Yl th(/3^)) . 

In the case of the If -sat model, we have 

(£)- = ! | ( c -0 + j p £ p JJ 1 + Jtth(^) 

Kp-l 



and 



2 The replica-symmetric bound. 

Given an arbitrary probability measure ( on R consider an i.i.d. sequence a^' -7 , / > 1 
with distribution £ and consider U it j(e) = U (0ij, x l { 3 , . . . , Xpii, e), where are independent 
copies of 9. Let us consider the Hamiltonian 

-H Ntt {a)= **K*. ■■■.<%.*) + £ E tfyfo) + (2-1) 

fc<Mt i<N j<k iit 

where M t is a Poisson r.v. with mean KM t = taN, and kij,i < N are i.i.d. Poisson r.v. with 
mean Efc ijt = (1 — £)ap. Let us define 

= ^Elog exp(-H N , t (tr)). 

Clearly, F N = The following Theorem holds. 

Theorem 1 bound). If conditions (1.2), (IS) and (1.4) hold then 

F N < $(C) = V(0) - a(p - 1)E log^)*, (2.2) 
where x = (x±, . . . , x p ) is a vector of i.i.d. r.v. with the distribution (. 
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First of all, since F N does not depend on (, Theorem 1 implies 

F N < $ = inf$(C). (2.3) 

Even though Theorem 1 holds for any H' N (cr), it is particularly interesting when 

= (2-4) 

i<N 

where (/ij)j<jv is a sequence of i.i.d. random variables. With this choice we can write 



(0) = ^E log ex PE(E U *M + h ^) 

i<JV<Ti=±l j'<fei,i 

= log 2 + E log Av exp (y~] U, (e) + he) , 



where Av mean average over e = ±1, and (Uj), h and k are copies of (C^ij), hi and 
correspondingly. In this case the bound (2.2) is usually written in Physics in terms of the 
functions B(xi, . . . , x p -i) and u(x±, . . . , x p -i) defined by 

Ve p = ±l Be^ u = {£)-. (2.5) 

In the case of the p-spin model (2.5) defines 

u = th- 1 (l + th(/3J) f[ th(/3x,) 

'<p-i 

and -B = ch.(/3 J) / da(/3u) . In the case of the If -sat model 

■b yj 1 + Jith(J3xi)\ // 6 -r-r 1 + J,th(/3a;j) 



and 



i<p-l ~ V l<p-l 



Kp-1 

To write </?(0) in terms of these functions B and -u, we observe that 



ip(0) = log 2 + ElogAvexp^ Uj(e) + he^j 

= log 2 + E log Y\ Bj Av exp UjS + hej , 



j<k j<k 

log 2 + apE log 5 + E log ch(J^ Uj + ft) , (2.6) 



3<k 



using that E/c = ap in the last line. 

In the case when H' N {&) = 0, it was proved in [9] (see Chapter 7, [10]) that for a small 
enough, 

lim F Af = $(C a ) = inf$(C) 

N—*co Q 

where ( a is the unique solution of the equation 

where Uj = Uj(x{, . . . , is defined in (2.5), x and x\ are i.i.d. with the distribution ( a , k 
is Poisson with EA; = ap and ~ means equality in distribution. 
Proof of Theorem 1. Let us consider the partition function 

Z = exp(-// JV)t (<r)) 



N 



(for simplicity of notations we omit the dependence of Z on iV and t) and define 

Z m = Z\.. and Ziu — Z\, 

m \M t =m % ' K lfcj,t=fc 

If we denote the Poisson p.f. as 7r(A, k) = (\ k /k\)e~ x then 

E log Z = Y n(taN, m)E log Z m 

m>0 

and, for any i < N, 

ElogZ = ^tt((1 - t)ap, k)E\ogZ hk . 

k>0 

Using the notation I(m > 1) = 1 if m > 1 and I(m > 1) = if m = 0, we have 

m=0 i=l fe=0 

oo 



= a^2(ir(taN,m- l)I(m > 1) - n(taN, m))E log Z m 

m=0 

- ap N S EW 1 - ^ fc - w ^ x ) - 7r (( 1 - *)°^' fc )) E1 °g^ 

i=l fc=0 

oo 

= a(^7r(taiV,m)ElogZ m+1 - ElogZ) 

m=0 

^ V oo 

~^iv E (X 7r((1 " fc)E log Zl ' k+1 ~ E log z ) ■ (2 ' 7) 



i=l fc=0 
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If we denote by (-) m the averaging w.r.t. the Gibbs measure corresponding to the Hamiltonian 
(2.1) for a fixed M t — m then 



and, therefore, 



Z m +i — Z m ( exp 9 m+ i (<7 iljm+1 , . . . , <J ip:m+1 ) 



n(taN, m)E log Z m+1 = ^ n(taN, m)E log Z. 

m=0 m=0 

oo 

+ K(taN, m)E log^ m+ i(<r ilim+1 , . . . , a ipm+1 ) 

m=0 

1 N 

= E\ogZ + — Elog(exp^K,...,a, p )), 



»i,...,i p =l 

where (•) now denotes averaging w.r.t. the Gibbs measure corresponding to the Hamiltonian 
(2.1) and 6 is independent of the randomness in (•). Similarly, 

oo 

- t)ap, k)E log Z i>fc+1 = E log Z + E log(exp Ufa)}, 

where U fa) = U(xi, . . . , x p -±, cr,) and where independent of randomness in 

(•). Finally, (2.7) implies 



1 N 1 N 

<p'(t) = a(— Elog(exp^(a n ,...,a v ))-p-^Elog(expf/(a,))). (2.8) 

ii,...,i p =l i=l 

bmce ip(l) = ip(0) + £ (p'(t)dt and since Elog(£)a; does not depend on t, to prove Theorem 
1 it suffices to show that 

1 N 1 N 

— ^og(exp9fa 1 ,...,a tp ))-p-J2^og^expUfa)} + (p-l)E\og(S) x <0. 

(2.9) 



U,...,i p =l i=l 



By assumptions (1.2) and (1.3) we can write 

log(expOfa 1 ,...,a ip )} = loga + log^l + 6^/i(a il ).../p(<r il> )^ 

= loga-^2——{f 1 fa 1 )...f p fa p ) 

n=l 

Using replicas cr 1 , . . . , cr™ we have 

ViK) . . . / P K)) n = (J] /:«) . . . 

Kb 



and, thus, 



N 



h,...,i p =l j<p 

where 

A jtn = A jtn (*\...,<r») = ± 1 £ l ]lf j (o\). 

i<N l<n 

Denote by E the expectation in fi, . . . , f p and xi, . . . ,x p only (the r.v. xi, . . . , x p are not 
present here and will appear in the terms below). Since fi, ■ ■ ■ , f p are i.i.d. and independent of 
the randomness in (•), Eo(rif<p A>) = (E rLf< p 4?>) = ( 5 n) where fi n = E A,- )n . Therefore, 
since we also assumed that b is independent of fi, . . . , f p , 



N 



^ E log(exp^K,...,a lp ))=E loga-E^(^)- (2-10) 

«l,...,ip=l n=l 

A similar analysis applies to the second term in (2.9). First of all, (1.5) implies that 
and, therefore, 

P-i 



n=l J=l v ' y 

e) exj 
•h(xj) 



n=l 1=1 



where in the last equality we used replicas. Now, 

i=l n=l Z=l v 17 



and taking the expectation w.r.t. fi, ■ ■ ■ , f p and x±, . . . , x p we get 

E -^log(expf/(^)) =E loga-^i^( J B n )(C n r 1 (2.11) 

where 



1=1 n=l 



C„ = E ( 



Av/j(£)exp£xf 



ch(xj) 

Finally, in absolutely similar manner 



Eolog^)* = E loga - V { -^{C n y. (2.12) 



n 

n=l 
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Combining (2.10), (2.11) and (2.12) we see that (2.9) can be written as 

- E ^^Vfi* - pBnCT 1 + (p- l)(C n y) < (2.13) 

n=l 

which holds true using condition (1.3) and the fact that x v — pxy p ~ l + (p — l)y p > for all 
x, y G R. This finishes the proof of Theorem 1. 

□ 

3 A general weighting scheme. 

The use of weighting scheme as considered in this section is directly motivated by the paper 
[1]. It is a very useful device, see e.g. [11]. 

We consider a countable index set T, an arbitrary sequence of r.v. (:r 7 ) 7gr and let 
(xl' hl ) l€ r for hjj > 1 be its independent copies of this sequence. We define 

V? J (e)=U(6 i j,x?'\...,x™,e) 

where 9 it j are independent copies of 9 and consider the Hamiltonian 

-HU°)= E **K,*>---><0 + £ E + H' N {0\ (3.1) 

k<M t i<N j<k i}t 

where M t and fcj )t , i < N are defined as in (2.1). 

Consider an arbitrary random sequence (t> 7 ) 7e r independent of all r.v. in (3.1) and such 
that X^er^y = 1 anc ^ define the Gibbs measure on T, N x T by 

C({cr,7}) =^7 ex P(-^7V,t( cr ))/^ 

where the partition function Z N is given by Z N = a t> 7 exp(— Hjf t (cr)). For a function 
/(<r,7) on Sjv x T, (•) will now denote the average with respect to the Gibbs measure G 

(/> = ^- E /(^7Kexp(-flJ it (ff)). (3.2) 
^ 7er,<TGS iV 

Let 

y>(t) = ^ElogE E ^exp(-/^»). 
Clearly, Fjy = The following Theorem holds. 
Theorem 2 . If conditions (1.2), (1.3) and (1.4) hold then 

F N < <p(0) - a(p - 1) J Elog^O^}^. (3.3) 
where x 1 = (xj, . . . , xj) and where (:r 7 ) 7g r are independent copies of (x 7 ) 7e r for I < p. 
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Of course, the integrand K\og((£) x i) in the last term of (3.3) depends on t through (■) since 
{£) x i is a function of 7. 

Proof. The proof follows that of Theorem 1 with almost no changes. (2.8) now becomes 

N N 

¥ /(*) = a(— Elog(exp^K,...,a Jp ))-p-^Elog(exp^(a i )}) (3.4) 

i\,...,i p =l i=l 

where (•) is given by (3.2). Similarly to (2.9) we will now show that 

1 N 1 N 

— Elog(exp^K,...,a lp ))-p-^Elog(exp^(a i )) + (p-l)Elog(^) a; ,) < 0. 

ii,...,i p =l i=l 

(3.5) 

This clearly implies the statement of Theorem 2 since if we denote c(t) = a( y p—l)E\og((£) xl ) 
then equation (3.5) yields <p'(t) + c(t) < and therefore 



99(1) < (p(0) - [ c(t)dt 
Jo 



which is precisely the statement of the Theorem. 

In the proof of Theorem 1 we showed that (2.9) is equivalent to (2.13). Following the 
same arguments one can show that (3.5) can be written as 



n=l 

where now 



J2 ^^-E(bp - pB n C*T\lu ■ ■ ■ , 7n) + (P - l)^(7i, • • • , In)) < 



Gn(7i,...,7»)=EoJ^ ch(x?) 

The one difference with the case of Theorem 1 is the fact that using replicas to represent 
(■) n now involves both cr and 7. For instance, in the calculations leading to (2.11) there will 
appear a term 



p-i 



im) n 



Avfi(e) exp ex]\ n 
ch(x7) 



1=1 

where (x^) 7e r, I > 1 are independent copies of (a; 7 ) 7g r independent of the randomness in (•). 
Using replicas (cr 1 , 7^, . . . , (cr n , j n ), this term can be written as 

UM-f,M 1111 cHx?) — )■ 
j=i 1=1 v 1 ' 

Averaging for i and taking expectation E w.r.t. fi, ■ ■ ■ , f p and (x]) yields 

^(vnrj AyJ tS CT? > (^ 7 ' J >- 
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Similarly, the calculations leading to (2.12) will produce (6^(71, 7 P )). The rest of the 
argument is the same. 

□ 

4 The 1-step of replica- symmetry breaking bound. 

In the context and with the notations of the previous section we will now make specific 
choices of the random sequences (i> 7 ) and (x^ 1 ' 1 ). From now on we will also assume that 
H' N {cr) is given by (2.4). 

We denote by M.\ the set of probability measures on M, and M 2 the set of probability 
measures on M.\. Consider ( <E A4 2 , our basic parameter on which will depend the bound 
we are going to obtain. We consider a sequence (f]i,xi)i>i with the following properties. The 
sequence (rji) is an i.i.d sequence of A4i distributed according to (. Conditionally on this 
sequence, the sequence (xi) is independent and x\ is distributed like r\[. We consider i.i.d. 
copies (rjijxj) of the sequence (r)i,xi). 

Theorem 3 Suppose that (1.2), (1-3) and (1-4) hold and H' N (er) is given by (2.4)- Let 
Uj{e) = U{9j ,Xi,..., Xp_i, e), where 9j are independent copies of 0, x — (27, . . . , x p ) and let 
k be a Poisson r.v. with mean Efc = ap. Then, for m G (0, 1) we have 

Fn < $i(t,m) =log2 + — ElogE / (Avexp(Vf/,(e) + /i£) ) — a{p — 1) — ElogE'((^) a ,) m , 

(4.1) 

where E' is the expectation w.r.t. (xi) and (x\) for fixed (r/i) and (rf t ) and E denotes the 
expectation w.r.t. (rji), (rf t ), (9j), k and h. 

Of course, Theorem 3 implies that 

F N < inf $i(C,m). 

It should also be noted that Theorem 3 is a generalization of Theorem 1, as is seen by taking 
m — > and ( concentrated at one point of M.\. 

The terms E'(-) m will magically appear with the proper choice of the sequence i> 7 , that we 
explain first. Let T be a set of natural numbers N. We consider a non- increasing enumeration 
(u 7 ) 7 >i of the points generated by Poisson process on M + of intensity measure x~ m ~ l . To 
avoid repetition, we will say that such a sequence has distribution S m . We define a sequence 
(uy) 7 >i by 



With the notation of [10], this sequence has the Poisson-Dirichlet distribution A m . This key 
property is as follows (see e.g. Proposition 6.5.15 in [10]). 
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Proposition 1 Consider a r.v. £ > 0, E£ 2 < oo and independent copies (£ 7 ) 7 >i- Then the 
sequences (w 7 £ 7 ) 7 >i and (■u 7 (E£j™) 1 / m )^ >1 nave i/ie same distribution and, therefore, 

E log ^ = E log ^ n 7 £ 7 - E log ^ Ul = - log EC- (4.2) 

7 >1 7>1 7>1 

Proof of Theorem 3. We consider an element 77 of Aii that is distributed according 
to ( and a sequence (x 7 ) 7 >i that, given r], is i.i.d distributed according to r). For I > 1 
we consider independent copies and [x]' 3,1 ) of these variables. We also consider other 
independent copies (rji) and {xj) of these variables. We denote by T the cx-algebra generated 
by the variables rji, r}\' 3 , hi, kij and 

Let us first consider the integrand Elog((£)a,7) in the last term of (3.3). Let us denote 

cr 

and e(j) = (S) x -y. Note that e(j) depends on xj,l > 1 and Z t {j) depends on x\ ,hl ,i, j,l > 
1 through the Hamiltonian Hjf t . By construction, given J 7 , the sequences (^t(7)) 7 >i and 
(e(7)) 7 >i are i.i.d. and independent of each other. If we denote by E' conditional expectation 
given T then, using Proposition 1, we get 

E'log((5>^) = E'log^M^ = E' log vAl)Zt{l) ~ E'log^^Z t ( 7 ) 

= — \ogE'(eZ t ) m - — logE'Z™ = — log(E'e m E'Z, m ) - — logE'Z" 1 = — logE'e™, 
m m m m m 

which is independent of t and, therefore, this yields the last term of (4.1). 
Next let us consider the first term in (3.3), y?(0). First of all, 

V?(0) = lElog5> 7 Z (7), 

where 

N N 

^o(7) = E ex P(-^»)= 2iV n Avex p(E U? tj (e)+h i e)=2 N l[F i ( 1 ), 

cr i=l 3<k ifi i=l 

and where we introduced the notation ^(7) = Avexp^^ J<fco U?j(e) + hie^j. By construc- 
tion, given J 7 , the sequences ^(7), 7 > 1 are i.i.d. and independent for different indices %. 
Therefore, application of Proposition 1 gives 

1 N 1 1 N 

-E' log 2^ J2 «7 II p i (7) = log 2 + ^ - log E' (J] Fi ( 1 ) ) m 

7>1 i=l i=l 
N 



= log2 + ^-logE'(F l (l))"\ 
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and taking expectation w.r.t. all the other r.v. implies 

V ?(0) = log2 + -ElogE / (F 1 (l))"\ 
which is precisely the first two terms in (4.1). 

□ 

5 The r-step of replica- symmetry breaking bound. 

We will first explain the choice of weights (i> 7 ) and r.v. (x 1 ) in Theorem 2 that will yield the 
r-step of replica symmetry breaking bound of Theorem 4 below. 

We take T = N r and define a sequence (t> 7 ) 7g r using Derrida-Ruelle cascades (see 
[8]). Consider arbitrary parameters < mi < . . . < m r < 1. Let us consider sequences 
(w 7l ) 7l >i, . . . , (w 7r ) 7r >i with the distributions S mi , . . . ,S mr correspondingly. For 2 < I < r 
let us consider a sequence ('^7i,...,7 i )7i,...,7 i >i that for any fixed (71, . . . , 7z_i) is an independent 
copy of the sequence (w 7i ) 7; >i. We define M 71) ... )7r , = nj=i M 7iv,7i an d 

2^y 1: ...x u 7i,-rt 

Next we define the set of r.v. 2^(71, ... , 7 r ) for w£0 and 71, . . . , 7 r > 1. 

Let A^i be a set of probability measures on R, and by induction for / < r we define Aii+i 
as a set of probability measures on yVf;. Let us fix ( G M r +i (our basic parameter) and define 
a random sequence (77, 77(71), . . . , 77(71, ■ ■ ■ ■> lr-i), x (li, • • • , 7r)) as follows. The element 77 of 
M. r is distributed according to (. Given 77, the sequence (?7(7i)) 7l >i of elements of Ai r -i is 
i.i.d distributed like 77. For 1 < I < r — 1, given all the elements 77(01, . . . , a s ) for all values of 
the integers a±, . . . , a s and all s < I — 1, the sequence (77(71, . . . , 7;))7;>i °f elements of Ai r -i 
is i.i.d distributed like 77(71, . . . , and these sequences are independent of each other for 

different values of (71, . . . , 7j-i). Finally, given all the elements 77(01, . . . , a s ) for all values of 
the integers ai, . . . , a s and all s < r — 1 the sequences £(71, . . . , j r ), 7 r > 1 is an i.i.d. sequence 
on R with the distribution 77(71, . . . , 7 r -i) and these sequences are independent for different 
values of (71, . . . , 7r-i)- The process of generating x's can be represented schematically as 

C -> 77 -> 77(71) 77(71, . . . , 7r _i) -> x(7i, . . . , 7 r ). (5.2) 

For simplicity of notations instead of writing various combination of indices I let us 
first consider an arbitrary countable index set fl. For w G il, we consider independent copies 
(Vu, Vudi), 770,(71, ... , 7 r _i), x w (7i, . . . , 7r)) of (77, 77(71), . . . , 77(71, . . . , 7 r _i), x(7i, . . . , 7 r )). 

For < j < r — 1, let us denote by Tj the cr-algebra generated by 77^(71, . . . ,7;) for 
to G Q, I < j, 71,..., 7; > 1, and by the r.v and fc^j. Let us denote by Ej the 

expectation given JF^- or, in other words, w.r.t. 77^(71, . . . , 7;) for uo G fi, / > j, 71, . . . , 7; > 1 
and #0,(71, . . . , 7 r ) for G fi, 71, . . . , 7 r > 1. In particular JF is generated by the variables 
f]u)i hi, 9i : j and kij. 
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(5.1) 



For a random variable U > we define T r U = U and by induction, for < / < r we 
define the r.v. XJ\ by 

T l U= (E,(r, +1 l/) m,+1 ) . (5.3) 
Let us consider a function V : M. n — > R, V > 0, and the r.v. 

\/( 7 i,...,7r) = v((^( 7l ,..., 7r ))^). (5.4) 

The distribution of the r.v. V(7i, . . . , 7r ) is independent of the value ( 7 i, . . . ,7 r ), and the 
r.v. 7j(V(7i, . . . , 7 r )) depends only on ^ ... , 7/. 

The following key property is based on iterative application of Proposition 1. It should 
be obvious to a reader familiar with Derrida-Ruelle cascades ([8]). In fact the essential ideas 
of the present scheme of proof are apparently known to the authors of [1], but for lack of 
references, it seems appropriate to give complete details. 

Proposition 2 IfVis defined by (5.4) and EV 2 < oo then 

Elog Yl v yu ... r/r V( lu ..., lr )=E\ogT V. (5.5) 

71,-,7r>l 

Proof. Let E' denote the expectation w.r.t. (f 7l ,..., 7r ) and (x a ,(7i, . . . ,7 r )) given JF , i.e. for 
a fixed sequence (rj w ). Let us first consider 

E'log M 7li ... i7r 1/(7 1 ,...,7 r ). 

7 l,..., 7 r>l 

By the definition of iZ 7lv .. j7r we can write 

U 7l,— ,7r 

71 >— >7r>l 7l> — >7r-l>l Kr-1 7 r>l 

For a fixed (71, . . . , 7 r _i), and given J>_i, the sequence V(7i, . . . , 7 r ), 7r > 1 is i.i.d. while the 
sequence (w 7 i,..., 7r ) 7r >i has distribution S mr . Therefore, writing for simplicity T r _iV rather 
than T r _ 1 l / (7i, • • • ,7 r ), Proposition 1 implies that 

Y "71,-, 7^(71, • • • , 7r) ~ (T r _iV) Y u iu-ar = (^-1^)^-1(71, • • • , 7 r _i), (5.6) 
7r >i 7r >i 

where ~ means equality in distribution and where we introduced the notation 

S r - l(7l) • • • ) 7r-l) = ^ 7 i,..., 7r _i, 7r - 

7r>l 

Of course, T r _iV depends on (7 1; . . . ,7 r _i), although this is not explicit in the notation. 
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Moreover, given J- r -\, both sides of (5.6) are by construction independent for different 
indices (71, ... , 7 r _i) and, thus, 

E W7l,-,7r^(7l,---,7r) ~ E II U 7i,-,'n( :r r-l^)5 , r _i(7i,...,7 r _i) 
7l,...,7 r >l 7i,...,7 r _i>l i<r— 1 

= e n u ^>-™ ( e 

(T r _ 1 y) ( S r _i(7i, . . . , 7 r _i)) . (5.7) 

7l,...,7 r ._2>l l<r-2 7r _i>l 

For a fixed (71, ... , 77.-2), and given JF r _ 2 , the sequences 

(T r _iV")(7i, . . . ,7 r _i) and S' r _i(7i, . . . ,7r-i) for 7 r _i > f 

are i.i.d. and by construction the sequence (u 71 ,... j7r _ 1 ) 77 ._ 1 >i has distribution S mr ,_ 1 . Therefore, 
Proposition 1 now implies that 



M 7l,...,7r-1 



E ti 71 ,..., 7r _ 1 (T r _iy)(7i, . . . ,7^1)^-1(71, • • • ,7r-i) ~ (T r _ 2 V)C mr ^ mr _ x E 

It- i>1 7t— i>1 

= (T r „ 2 V r )C , mrimri S' r _2(7i, • • • ,7r-2), (5-8) 
where £7.-2(71, • • • , 7r- 2 ) = E 7r _ x >i «7i,...,7r-i and 

O^-i = (E(5 r _ 1 ( 7 i,...,7r-i)) mp - 1 ) 1/mP " 1 = (E(E u >) mr " 1 ) 1/mr " 1 ' 

7r>l 

where (w 7r ) 7r >i has distribution S mr . One can easily check that C mr ,m r _i < 00 due to the 
fact that m r _i < m r . 

Given J>_ 2 , both sides of (5.8) are independent for different (71, . . . , 7 r _2) and, therefore, 
(5.7) implies 

E ^,..,>n7l,...,7r)~ E II 

w 7li ... i 7 ; (T r _ 2 l / )C mr)mri S' r _ 2 (7i, . . . , 77.-2) 

7l,...,7r>l 7i.->7r-2>li<r-2 

= E II U 7i.-.'w( E M 7i,-,7r-2( T r-2V)C mr , mr _ 1 S' r _ 2 (7i, . . . ,7 r _ 2 )j. 

71, — >7r-3>l Kr-3 7r-2>l 

Let us define 



^-i = (E(E«7ir _1 )' 



l/m.j_i 

7j>l 

where the sequence (w 7 -) 7j >i has distribution H m and let 
Denote 



^■(7i,---,7j) = E 

7j+i>1 
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M 7iv,7j+i- 



Repeating the same argument as above one can show by decreasing induction over j that 
«7i,-.,7^(7l, • • • , 7r) ~ II 

(f^'K:,.,V ; !-i ',))• (5.9) 

7l,...,7r>l 7l,-,7j>l l<3 

In particular, for j = 0, (5.9) reads 

5^ «7i,-,7r^(7l, • • • ,7r) ~ (To^)Ci M 71 , 
7l,...,7r>l 71>1 

which yields 

E' log Y u 7l) ... ) 7 I .V(7i, . . . , 7 r ) = E' log u^,...^,. V(7i, . . . , 7r) - E' log M 7l ,..., 7r 

= E'log^otOd ^ m 71 - E'logd ^ u 71 = logT \/. 

71>1 71>1 

Taking the expectation gives (5.5). 

□ 

Let Q be a set of different combinations that appear as indices of all 

different r.v. in Section 3. We consider i.i.d copies (9u)wen of 0. Let £0,(71, . . . , j r ) an d f 71 ,... l7r 
be defined by (5.2) and (5.1) and let (x^^en be an independent copy of . . . , l))u,en- 

The following Theorem is a consequence of Theorem 2. 

Theorem 4 Suppose that (1.2), (IS) and (1-4) hold and H' N (cr) is given by (2.4)- Let 
Uj(e) = U(9j,x{, . . . ,Xp_ 1; e), x — (xi, . . . ,x p ) and let k be a Poisson r.v. with mean Kk = 
ap. Then 

F N < $ r ((,mi,..,m r ) = log2 + ElogT (AvexpQ^ Uj{e) + hefj - a(p - l)E\ogT (S} x , 

(5.10) 

where T is defined in (5.3) and E denotes the expectation w.r.t. (rji), (77/), (9j), k and h. 

Of course, the Theorem implies that 

Fn < $r = inf $ r (£, mi, . . . , m r ). 

C,mi,...,m r 

One expects that as in the Sherrington-Kirkpatrick (SK) model ([12]) these bounds are 
always exact, i.e. 

lim Fn = inf <3> r , 

N^oo r>0 

where $0 was defined in (2.3). Probably, this is going to be much harder to prove than 
the Parisi formula in the SK model. The hope that these bounds are exact is not based on 
anything concrete but rather on what may be called the generalized Parisi conjecture that 
the Replica Symmetry Breaking scheme, when properly applied, always yields the correct 
free energy. 
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Proof of Theorem 4. The proof is almost identical to the proof of Theorem 3 with 
Proposition 2 now playing the role of Proposition 1. To simplify the notations we will write 
7 = (71, ... , 7 r ), and to match the notations of Theorem 2 we write x^ = 2^(71, • • • , 7r)- Let 
us first consider the integrand Elog^f)^) in the last term of (3.3). Let us denote 

^(7)=£exp(-#;>)) 

a 

and e(7) = (£) x i- Note that e{^) depends on 2^(7), Z > 1 and Z t {pj) depends on x\' hl = 
x l f (71, • • • ,j r ),i,j, I > 1 through the Hamiltonian Hj^ t . By construction, given JF , the 
sequences (^(7)) and (e(7)) are defined as in (5.4) and independent of each other. Using 
Proposition 2, we get 

Elog(<£)*r) = Elog^^^M = Elog J> 7 e( 7 )^(7) - ElogJ>7^(7) 

= ElogT (e^) - E\ogT Z t = E log(T e)(T Z t ) -E\ogT Z t = ElogT e, 

which is independent of t and, therefore, this yields the last term of (5.10). 
Next let us consider the first term in (3.3), ip(0). First of all, 

y?(0) = -^ElogJ> 7 Zo(7), 

7 

where 

N N 

Z (7)=X) ex P(-^»)= 2JV II Avex p(E W+te) =* T U F M> 

cr i=l j<fci,o * =1 

and where we introduced the notation ^(7) = Avexp(J^ - <fcjo U^j(e) + foj£). Given JF , the 
sequences (F^))^^ are independent for different indices i. Therefore, the application of 
Proposition 2 gives, writing = ^(7) for 7 = (1, • • • , 1), 

1 * 1 " 

-E log 2 N II **(7) = log 2 + -E log T JJ 

7 i=l i=l 

1 " 

= log 2 + - ^ E log T ( 1 ) = log 2 + E log T Fx ( 1 ) , 
i=i 

which is precisely the first two terms in (5.10). 

□ 
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